Online Training Through Time for Spiking Neural Networks

Spiking neural networks (SNNs) are promising brain-inspired energy-efficient models. Recent progress in training methods has enabled successful deep SNNs on large-scale tasks with low latency. Particularly, backpropagation through time (BPTT) with surrogate gradients (SG) is popularly used to achieve high performance in a very small number of time steps. However, it is at the cost of large memory consumption for training, lack of theoretical clarity for optimization, and inconsistency with the online property of biological learning and rules on neuromorphic hardware. Other works connect spike representations of SNNs with equivalent artificial neural network formulation and train SNNs by gradients from equivalent mappings to ensure descent directions. But they fail to achieve low latency and are also not online. In this work, we propose online training through time (OTTT) for SNNs, which is derived from BPTT to enable forward-in-time learning by tracking presynaptic activities and leveraging instantaneous loss and gradients. Meanwhile, we theoretically analyze and prove that gradients of OTTT can provide a similar descent direction for optimization as gradients based on spike representations under both feedforward and recurrent conditions. OTTT only requires constant training memory costs agnostic to time steps, avoiding the significant memory costs of BPTT for GPU training. Furthermore, the update rule of OTTT is in the form of three-factor Hebbian learning, which could pave a path for online on-chip learning. With OTTT, it is the first time that two mainstream supervised SNN training methods, BPTT with SG and spike representation-based training, are connected, and meanwhile in a biologically plausible form. Experiments on CIFAR-10, CIFAR-100, ImageNet, and CIFAR10-DVS demonstrate the superior performance of our method on large-scale static and neuromorphic datasets in small time steps.Comment: Accepted by NeurIPS 202

Coding the negative emotions of family members and patients among the high-risk preoperative conversations with the Chinese version of VR-CoDES

Abstract Background Little is known about family members' and patients' expression of negative emotions among high‐risk preoperative conversations. Objectives This study aimed to identify the occurrence and patterns of the negative emotions of family members and patients in preoperative conversations, to investigate the conversation themes and to explore the correlation between the negative emotions and the conversation themes. Methods A retrospective study was conducted using the Chinese version of Verona Coding Definitions of Emotional Sequences (VR‐CoDES‐C) to code 297 conversations on high‐risk procedures. Inductive content analysis was used to analyse the topics in which negative emotions nested. The χ2 Test was used to test the association between the cues and the conversation themes. Results The occurrence rate of family members' and patients' negative emotions was very high (85.9%), much higher when compared to most conversations under other medical settings. The negative emotions were mainly expressed by cues (96.4%), and cue‐b (67.4%) was the most frequent category. Cues and concerns were mostly elicited by family members and patients (71.6%). Negative emotions were observed among seven themes, in which ‘Psychological stress relating to illness severity, family's care and financial burden’ (30.3%) ranked the top. Cue‐b, cue‐c and cue‐d had a significant correlation (p < .001) with certain themes. Conclusions Family members and patients conveyed significantly more negative emotions in the high‐risk preoperative conversations than in other medical communications. Certain categories of cues were induced by specific emotional conversation contents. Patient Contribution Family members and patients contributed to data

How physicians respond to negative emotions in high-risk preoperative conversations

This work was supported by the China Medical Board, CMB 14-200.Objective To investigate physicians’ responses to negative emotions in high-risk preoperative conversations; and to explore the influencing factors of these responses. Methods One hundred and sixty-two audio recordings were coded using the Chinese Verona Coding Definition of Emotional Sequences (VR-CoDES). Big Five Personality Inventory Brief Version and Emotional Intelligence Scale were administered to explore the influencing factors of physicians’ responses. SPSS 24.0 and R 3.6.3 LME4 Package were used for data analysis. Results Reduce Space (83%), referring to physicians’ responses reducing the opportunities of patients to disclose emotions, was physicians’ most frequent response to patients or families’ emotions. The main responses were Information-advice (ERIa) and Ignoring (NRIa). Younger age, female, Agreeableness and Openness were factors positively associated with Explicit Provide Space (EP); Neuroticism was negatively correlated with EP. Extroversion was negatively correlated with Explicit Reduce Space (ER); Conscientiousness was negatively correlated with both EP and ER responses. Emotional intelligence had no significant influence on physicians’ responses. Conclusion The majority of physicians were inclined to reduce space by providing information advice or ignoring. Physicians’ responses were correlated with their gender, age and personality traits. Practice Implications The trainees’ gender, age and personality should be considered when conducting doctor-patient communication skills training.Publisher PDFPeer reviewe

Coarse-graining research of the thermal infrared anomalies before earthquakes in the Sichuan area on Google Earth engine

Seismo-induced Thermal infrared (TIR) anomalies has been proposed as a significant precursor of earthquakes. Several methods have been proposed to detect Thermal infrared anomalies that may be associated with earthquakes. However, there is no comparison of the influence for Thermal infrared extraction methods with a long time statistical analysis. To quantify the effects of various techniques used in Thermal infrared anomaly extraction, in this paper, we offer a complete workflow of their comparative impacts. This study was divided into three parts: anomaly detection, statistical analysis, and tectonic factor research. For anomaly detection, daily continuous nighttime surface temperature (ConLST) data was obtained from the Google Earth Engine (GEE) platform, and each different anomaly detection method was used to detect Thermal infrared outliers in the Sichuan region (27°-37°N, 97°-107°E). During statistical analysis, The heated core model was applied to explore Thermal infrared anomalies which is to filter anomalies unrelated to earthquakes by setting time-space-intensity conditions. The 3D error diagram offers scores to assume the best parameter set using training-test-validation steps. In the final part, we considered information on stresses, active faults, and seismic zones to determine the optimal parameters for extracting the Thermal infrared anomalies. The Kalman filter method detected the highest seismic anomaly frequency without considerating the heating core condition. The Autoencoder and Isolation Forest methods obtain the optimal alert type and parameter set to determine if the anomaly is likely earthquake-related. The RST method performs optimally in the final part of the workflow when it considers physical factors such as active faults, seismic zones, and stresses. However, The six methods we have chosen are not sufficient to contain the entire Thermal infrared anomaly extraction. The consideration of tectonic factors in the research remains poorly developed, as statistical methods were not employed to explore the role of constructive factors. Nevertheless, it is a significant factor in comparing anomaly extraction methods and precursor studies

Calcium Supplementation Enhanced Adipogenesis and Improved Glucose Homeostasis Through Activation of Camkii and PI3K/Akt Signaling Pathway in Porcine Bone Marrow Mesenchymal Stem Cells (pBMSCs) and Mice Fed High Fat Diet (HFD)

Background/Aims: It has been implicated that calcium supplementation is involved in reducing body weight/fat and improving glucose homeostasis. However, the underlying mechanisms are still not fully understood. Here, we investigated the effects of calcium supplementation on adipogenesis and glucose homeostasis in porcine bone marrow mesenchymal stem cells (pBMSCs) and high fat diet (HFD)-fed mice and explored the involved signaling pathways. Methods: In vitro, pBMSCs were treated with 4 mM extracellular calcium ([Ca2+]o) and/or 1 μM nifedipine, 0.1 μM BAPTA-AM, 1 μM KN-93, 50 nM wortmannin for 10 days. The intracellular calcium ([Ca2+]i) levels were measured using Fluo 3-AM by flow cytometry. The adipogenic differentiation of pBMSCs was determined by Oil Red-O staining and triglyceride assay. The expression of marker genes involved in adipogenesis (peroxisome proliferator activated receptor γ (PPARγ) and CCAAT/enhancer binding protein α (C/EBPα)) and glucose uptake (glucose transporter 4 (GLUT4)), as well as the activation of Ca2+/calmodulin-dependent protein kinase II (CaMKII) and PI3K/Akt-FoxO1/AS160 signaling pathways were determined by Western blotting. Glucose uptake and utilization were examined using 2-NBDG assay and glucose content assay, respectively. In vivo, C57BL/6J male mice were fed a HFD (containing 1.2% calcium) without or with 0.6% (w/w) calcium chloride in drinking water for 13 weeks. The adipogenesis, glucose homeostasis and the involvement of CaMKII and PI3K/Akt signaling pathway were also assessed. Results: In vitro, [Ca2+]o stimulated pBMSCs adipogenesis by increasing [Ca2+]i level and activating CaMKII and PI3K/Akt-FoxO1 pathways. In addition, [Ca2+]o promoted glucose uptake/utilization by enhancing AS160 phosphorylation, GLUT4 expression and translocation. However, the stimulating effects of [Ca2+]o on pBMSCs adipogenesis and glucose uptake/utilization were abolished by L-VGCC blocker Nifedipine, [Ca2+]i chelator BAPTA-AM, CaMKII inhibitor KN-93, or PI3K inhibitor Wortmannin. In vivo, calcium supplementation decreased body weight and fat content, increased adipocyte number, and improved glucose homeostasis, with elevated PPARγ and GLUT4 expression and PI3K/Akt activation in iWAT. Conclusion: calcium supplementation enhanced adipogenesis and glucose uptake in pBMSCs, which was coincident with the increased adipocyte number and improved glucose homeostasis in HFD-fed mice, and was associated with activation of CaMKII and PI3K/Akt-FoxO1/AS160 pathways. These data provided a broader understanding of the mechanisms underlying calcium-induced body weight/fat loss and glycemic control

Direct observation of high temperature superconductivity in one-unit-cell FeSe films

Heterostructure based interface engineering has been proved an effective method for finding new superconducting systems and raising superconductivity transition temperature (TC). In previous work on one unit-cell (UC) thick FeSe films on SrTiO3 (STO) substrate, a superconducting-like energy gap as large as 20 meV, was revealed by in situ scanning tunneling microscopy/spectroscopy (STM/STS). Angle resolved photoemission spectroscopy (ARPES) further revealed a nearly isotropic gap of above 15 meV, which closes at a temperature of ~ 65 K. If this transition is indeed the superconducting transition, then the 1-UC FeSe represents the thinnest high TC superconductor discovered so far. However, up to date direct transport measurement of the 1-UC FeSe films has not been reported, mainly because growth of large scale 1-UC FeSe films is challenging and the 1-UC FeSe films are too thin to survive in atmosphere. In this work, we successfully prepared 1-UC FeSe films on insulating STO substrates with non-superconducting FeTe protection layers. By direct transport and magnetic measurements, we provide definitive evidence for high temperature superconductivity in the 1-UC FeSe films with an onset TC above 40 K and a extremely large critical current density JC ~ 1.7*106 A/cm2 at 2 K. Our work may pave the way to enhancing and tailoring superconductivity by interface engineering

Production of Transgenic Pigs Mediated by Pseudotyped Lentivirus and Sperm

Sperm-mediated gene transfer can be a very efficient method to produce transgenic pigs, however, the results from different laboratories had not been widely repeated. Genomic integration of transgene by injection of pseudotyped lentivirus to the perivitelline space has been proved to be a reliable route to generate transgenic animals. To test whether transgene in the lentivirus can be delivered by sperm, we studied incubation of pseudotyped lentiviruses and sperm before insemination. After incubation with pig spermatozoa, 62±3 lentiviral particles were detected per 100 sperm cells using quantitative real-time RT-PCR. The association of lentivirus with sperm was further confirmed by electron microscopy. The sperm incubated with lentiviral particles were artificially inseminated into pigs. Of the 59 piglets born from inseminated 5 sows, 6 piglets (10.17%) carried the transgene based on the PCR identification. Foreign gene and EGFP was successfully detected in ear tissue biopsies from two PCR-positive pigs, revealed via in situ hybridization and immunohistochemistry. Offspring of one PCR-positive boar with normal sows showed PCR-positive. Two PCR-positive founders and offsprings of PCR-positive boar were further identified by Southern-blot analysis, out of which the two founders and two offsprings were positive in Southern blotting, strongly indicating integration of foreign gene into genome. The results indicate that incubation of sperm with pseudotyped lentiviruses can incorporated with sperm-mediated gene transfer to produce transgenic pigs with improved efficiency

Robust estimation of bacterial cell count from optical density

Optical density (OD) is widely used to estimate the density of cells in liquid culture, but cannot be compared between instruments without a standardized calibration protocol and is challenging to relate to actual cell count. We address this with an interlaboratory study comparing three simple, low-cost, and highly accessible OD calibration protocols across 244 laboratories, applied to eight strains of constitutive GFP-expressing E. coli. Based on our results, we recommend calibrating OD to estimated cell count using serial dilution of silica microspheres, which produces highly precise calibration (95.5% of residuals &lt;1.2-fold), is easily assessed for quality control, also assesses instrument effective linear range, and can be combined with fluorescence calibration to obtain units of Molecules of Equivalent Fluorescein (MEFL) per cell, allowing direct comparison and data fusion with flow cytometry measurements: in our study, fluorescence per cell measurements showed only a 1.07-fold mean difference between plate reader and flow cytometry data